Automated audio data selector

ABSTRACT

Aspects define a capture signal as audio inputs by a user of word content. An input of the capture signal word content is recognized in response to an audio input of the user reciting the capture signal word content into a microphone in communication with the recording device during a recording of a speech presentation by the recording device. A recording portion start time is identified that is prior to a time of the input of the capture signal during the current recording of the audio speech presentation in response to recognizing the input of the capture signal word content from the user. The recording device is driven to capture a portion of the recorded audio speech presentation over a period of time spanning from the recording portion start time to the time of the input of the capture signal word content.

BACKGROUND

It is common to create audio recordings of speaker presentations,dictated notes and observations, and multi-person conversations,interviews, meetings, etc. The audio recordings of a given event mayinclude one or more digital audio data files or analog media, such asmagnetic tape and vinyl record recordings.

While recording a given event may be easy, making effective use of therecording may be difficult. The longer the time of the event, thegreater the amount of recording data that must be obtained andsubsequently reviewed in order to recover desired information from theevent via the recording. Accordingly, the efficiencies involved withreviewing audio recordings of an event in order to subsequently identifyand retrieve information of interest diminish in proportion to theamount the recording data. In the case of a recording that includesaudio recorded from multiple persons, distinguishing the content fromany one person may also be difficult.

BRIEF SUMMARY

In one aspect of the present invention, a method for the automatedgeneration of audio selections includes defining a capture signal as anaudio input into a microphone of a recording device of a recitation by auser of word content (a specific word or a phrase of multiple specificwords). An input of the capture signal word content to a recordingdevice is recognized in response to an audio input of the user recitingthe capture signal word content into a microphone in communication withthe recording device during a recording of a speech presentation by therecording device. A recording portion start time is identified that isprior to a time of the input of the capture signal during the currentrecording of the audio speech presentation in response to recognizingthe input of the capture signal word content from the user. Therecording device is thus driven to capture a portion of the recordedaudio speech presentation over a period of time spanning from therecording portion start time to the time of the input of the capturesignal word content.

In another aspect, a system has a hardware processor in circuitcommunication with a computer readable memory and a computer-readablestorage medium having program instructions stored thereon. The processorexecutes the program instructions stored on the computer-readablestorage medium via the computer readable memory and thereby defines acapture signal as an audio input into a microphone of a recording deviceof a recitation by a user of word content (a specific word or a phraseof multiple specific words). An input of the capture signal word contentto a recording device is recognized in response to an audio input of theuser reciting the capture signal word content into a microphone incommunication with the recording device during a recording of a speechpresentation by the recording device. A recording portion start time isidentified that is prior to a time of the input of the capture signalduring the current recording of the audio speech presentation inresponse to recognizing the input of the capture signal word contentfrom the user. The recording device is thus driven to capture a portionof the recorded audio speech presentation over a period of time spanningfrom the recording portion start time to the time of the input of thecapture signal word content.

In another aspect, a computer program product for the automatedgeneration of audio selections has a computer-readable storage mediumwith computer readable program code embodied therewith. The computerreadable hardware medium is not a transitory signal per se. The computerreadable program code includes instructions for execution which causethe processor to define a capture signal as an audio input into amicrophone of a recording device of a recitation by a user of wordcontent (a specific word or a phrase of multiple specific words). Aninput of the capture signal word content to a recording device isrecognized in response to an audio input of the user reciting thecapture signal word content into a microphone in communication with therecording device during a recording of a speech presentation by therecording device. A recording portion start time is identified that isprior to a time of the input of the capture signal during the currentrecording of the audio speech presentation in response to recognizingthe input of the capture signal word content from the user. Therecording device is thus driven to capture a portion of the recordedaudio speech presentation over a period of time spanning from therecording portion start time to the time of the input of the capturesignal word content.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of embodiments of the present invention will bemore readily understood from the following detailed description of thevarious aspects of the invention taken in conjunction with theaccompanying drawings in which:

FIG. 1 depicts a cloud computing environment according to an embodimentof the present invention.

FIG. 2 depicts a cloud computing node according to an embodiment of thepresent invention.

FIG. 3 depicts a computerized aspect according to an embodiment of thepresent invention.

FIG. 4 is a flow chart illustration of a process or system for theautomated generation of audio selections according to an embodiment ofthe present invention.

DETAILED DESCRIPTION

The present invention may be a system, a method, and/or a computerprogram product at any possible technical detail level of integration.The computer program product may include a computer readable storagemedium (or media) having computer readable program instructions thereonfor causing a processor to carry out aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, configuration data for integrated circuitry, oreither source code or object code written in any combination of one ormore programming languages, including an object oriented programminglanguage such as Smalltalk, C++, or the like, and procedural programminglanguages, such as the “C” programming language or similar programminglanguages. The computer readable program instructions may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider). In some embodiments, electronic circuitry including,for example, programmable logic circuitry, field-programmable gatearrays (FPGA), or programmable logic arrays (PLA) may execute thecomputer readable program instructions by utilizing state information ofthe computer readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

It is understood in advance that although this disclosure includes adetailed description on cloud computing, implementation of the teachingsrecited herein are not limited to a cloud computing environment. Rather,embodiments of the present invention are capable of being implemented inconjunction with any other type of computing environment now known orlater developed.

Cloud computing is a model of service delivery for enabling convenient,on-demand network access to a shared pool of configurable computingresources (e.g. networks, network bandwidth, servers, processing,memory, storage, applications, virtual machines, and services) that canbe rapidly provisioned and released with minimal management effort orinteraction with a provider of the service. This cloud model may includeat least five characteristics, at least three service models, and atleast four deployment models.

Characteristics are as follows:

On-demand self-service: a cloud consumer can unilaterally provisioncomputing capabilities, such as server time and network storage, asneeded automatically without requiring human interaction with theservice's provider.

Broad network access: capabilities are available over a network andaccessed through standard mechanisms that promote use by heterogeneousthin or thick client platforms (e.g., mobile phones, laptops, and PDAs).

Resource pooling: the provider's computing resources are pooled to servemultiple consumers using a multi-tenant model, with different physicaland virtual resources dynamically assigned and reassigned according todemand. There is a sense of location independence in that the consumergenerally has no control or knowledge over the exact location of theprovided resources but may be able to specify location at a higher levelof abstraction (e.g., country, state, or datacenter).

Rapid elasticity: capabilities can be rapidly and elasticallyprovisioned, in some cases automatically, to quickly scale out andrapidly released to quickly scale in. To the consumer, the capabilitiesavailable for provisioning often appear to be unlimited and can bepurchased in any quantity at any time.

Measured service: cloud systems automatically control and optimizeresource use by leveraging a metering capability at some level ofabstraction appropriate to the type of service (e.g., storage,processing, bandwidth, and active user accounts). Resource usage can bemonitored, controlled, and reported providing transparency for both theprovider and consumer of the utilized service.

Service Models are as follows:

Software as a Service (SaaS): the capability provided to the consumer isto use the provider's applications running on a cloud infrastructure.The applications are accessible from various client devices through athin client interface such as a web browser (e.g., web-based e-mail).The consumer does not manage or control the underlying cloudinfrastructure including network, servers, operating systems, storage,or even individual application capabilities, with the possible exceptionof limited user-specific application configuration settings.

Platform as a Service (PaaS): the capability provided to the consumer isto deploy onto the cloud infrastructure consumer-created or acquiredapplications created using programming languages and tools supported bythe provider. The consumer does not manage or control the underlyingcloud infrastructure including networks, servers, operating systems, orstorage, but has control over the deployed applications and possiblyapplication hosting environment configurations.

Infrastructure as a Service (IaaS): the capability provided to theconsumer is to provision processing, storage, networks, and otherfundamental computing resources where the consumer is able to deploy andrun arbitrary software, which can include operating systems andapplications. The consumer does not manage or control the underlyingcloud infrastructure but has control over operating systems, storage,deployed applications, and possibly limited control of select networkingcomponents (e.g., host firewalls).

Deployment Models are as follows:

Private cloud: the cloud infrastructure is operated solely for anorganization. It may be managed by the organization or a third party andmay exist on-premises or off-premises.

Community cloud: the cloud infrastructure is shared by severalorganizations and supports a specific community that has shared concerns(e.g., mission, security requirements, policy, and complianceconsiderations). It may be managed by the organizations or a third partyand may exist on-premises or off-premises.

Public cloud: the cloud infrastructure is made available to the generalpublic or a large industry group and is owned by an organization sellingcloud services.

Hybrid cloud: the cloud infrastructure is a composition of two or moreclouds (private, community, or public) that remain unique entities butare bound together by standardized or proprietary technology thatenables data and application portability (e.g., cloud bursting forload-balancing between clouds).

A cloud computing environment is service oriented with a focus onstatelessness, low coupling, modularity, and semantic interoperability.At the heart of cloud computing is an infrastructure comprising anetwork of interconnected nodes.

Referring now to FIG. 1, illustrative cloud computing environment 50 isdepicted. As shown, cloud computing environment 50 comprises one or morecloud computing nodes 10 with which local computing devices used bycloud consumers, such as, for example, personal digital assistant (PDA)or cellular telephone 54A, desktop computer 54B, laptop computer 54C,and/or automobile computer system 54N may communicate. Nodes 10 maycommunicate with one another. They may be grouped (not shown) physicallyor virtually, in one or more networks, such as Private, Community,Public, or Hybrid clouds as described hereinabove, or a combinationthereof. This allows cloud computing environment 50 to offerinfrastructure, platforms and/or software as services for which a cloudconsumer does not need to maintain resources on a local computingdevice. It is understood that the types of computing devices 54A-N shownin FIG. 1 are intended to be illustrative only and that computing nodes10 and cloud computing environment 50 can communicate with any type ofcomputerized device over any type of network and/or network addressableconnection (e.g., using a web browser).

Referring now to FIG. 2, a set of functional abstraction layers providedby cloud computing environment 50 (FIG. 1) is shown. It should beunderstood in advance that the components, layers, and functions shownin FIG. 2 are intended to be illustrative only and embodiments of theinvention are not limited thereto. As depicted, the following layers andcorresponding functions are provided:

Hardware and software layer 60 includes hardware and softwarecomponents. Examples of hardware components include: mainframes 61; RISC(Reduced Instruction Set Computer) architecture based servers 62;servers 63; blade servers 64; storage devices 65; and networks andnetworking components 66. In some embodiments, software componentsinclude network application server software 67 and database software 68.

Virtualization layer 70 provides an abstraction layer from which thefollowing examples of virtual entities may be provided: virtual servers71; virtual storage 72; virtual networks 73, including virtual privatenetworks; virtual applications and operating systems 74; and virtualclients 75.

In one example, management layer 80 may provide the functions describedbelow. Resource provisioning 81 provides dynamic procurement ofcomputing resources and other resources that are utilized to performtasks within the cloud computing environment. Metering and Pricing 82provide cost tracking as resources are utilized within the cloudcomputing environment, and billing or invoicing for consumption of theseresources. In one example, these resources may comprise applicationsoftware licenses. Security provides identity verification for cloudconsumers and tasks, as well as protection for data and other resources.User portal 83 provides access to the cloud computing environment forconsumers and system administrators. Service level management 84provides cloud computing resource allocation and management such thatrequired service levels are met. Service Level Agreement (SLA) planningand fulfillment 85 provide pre-arrangement for, and procurement of,cloud computing resources for which a future requirement is anticipatedin accordance with an SLA.

Workloads layer 90 provides examples of functionality for which thecloud computing environment may be utilized. Examples of workloads andfunctions which may be provided from this layer include: mapping andnavigation 91; software development and lifecycle management 92; virtualclassroom education delivery 93; data analytics processing 94;transaction processing 95; and processing 96 according to embodimentsfor the automated generation of audio selections as depicted in FIG. 4and described below.

FIG. 3 is a schematic of an example of a programmable deviceimplementation 10 according to an aspect of the present invention, whichmay function as a cloud computing node within the cloud computingenvironment of FIG. 2. Programmable device implementation 10 is only oneexample of a suitable implementation and is not intended to suggest anylimitation as to the scope of use or functionality of embodiments of theinvention described herein. Regardless, programmable deviceimplementation 10 is capable of being implemented and/or performing anyof the functionality set forth hereinabove.

A computer system/server 12 is operational with numerous other generalpurpose or special purpose computing system environments orconfigurations. Examples of well-known computing systems, environments,and/or configurations that may be suitable for use with computersystem/server 12 include, but are not limited to, personal computersystems, server computer systems, thin clients, thick clients, hand-heldor laptop devices, multiprocessor systems, microprocessor-based systems,set top boxes, programmable consumer electronics, network PCs,minicomputer systems, mainframe computer systems, and distributed cloudcomputing environments that include any of the above systems or devices,and the like.

Computer system/server 12 may be described in the general context ofcomputer system-executable instructions, such as program modules, beingexecuted by a computer system. Generally, program modules may includeroutines, programs, objects, components, logic, data structures, and soon that perform particular tasks or implement particular abstract datatypes. Computer system/server 12 may be practiced in distributed cloudcomputing environments where tasks are performed by remote processingdevices that are linked through a communications network. In adistributed cloud computing environment, program modules may be locatedin both local and remote computer system storage media including memorystorage devices.

The computer system/server 12 is shown in the form of a general-purposecomputing device. The components of computer system/server 12 mayinclude, but are not limited to, one or more processors or processingunits 16, a system memory 28, and a bus 18 that couples various systemcomponents including system memory 28 to processor 16.

Bus 18 represents one or more of any of several types of bus structures,including a memory bus or memory controller, a peripheral bus, anaccelerated graphics port, and a processor or local bus using any of avariety of bus architectures. By way of example, and not limitation,such architectures include Industry Standard Architecture (ISA) bus,Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, VideoElectronics Standards Association (VESA) local bus, and PeripheralComponent Interconnects (PCI) bus.

Computer system/server 12 typically includes a variety of computersystem readable media. Such media may be any available media that isaccessible by computer system/server 12, and it includes both volatileand non-volatile media, removable and non-removable media.

System memory 28 can include computer system readable media in the formof volatile memory, such as random access memory (RAM) 30 and/or cachememory 32. Computer system/server 12 may further include otherremovable/non-removable, volatile/non-volatile computer system storagemedia. By way of example only, storage system 34 can be provided forreading from and writing to a non-removable, non-volatile magnetic media(not shown and typically called a “hard drive”). Although not shown, amagnetic disk drive for reading from and writing to a removable,non-volatile magnetic disk (e.g., a “floppy disk”), and an optical diskdrive for reading from or writing to a removable, non-volatile opticaldisk such as a CD-ROM, DVD-ROM or other optical media can be provided.In such instances, each can be connected to bus 18 by one or more datamedia interfaces. As will be further depicted and described below,memory 28 may include at least one program product having a set (e.g.,at least one) of program modules that are configured to carry out thefunctions of embodiments of the invention.

Program/utility 40, having a set (at least one) of program modules 42,may be stored in memory 28 by way of example, and not limitation, aswell as an operating system, one or more application programs, otherprogram modules, and program data. Each of the operating system, one ormore application programs, other program modules, and program data orsome combination thereof, may include an implementation of a networkingenvironment. Program modules 42 generally carry out the functions and/ormethodologies of embodiments of the invention as described herein.

Computer system/server 12 may also communicate with one or more externaldevices 14 such as a keyboard, a pointing device, a display 24, etc.;one or more devices that enable a user to interact with computersystem/server 12; and/or any devices (e.g., network card, modem, etc.)that enable computer system/server 12 to communicate with one or moreother computing devices. Such communication can occur via Input/Output(I/O) interfaces 22. Still yet, computer system/server 12 cancommunicate with one or more networks such as a local area network(LAN), a general wide area network (WAN), and/or a public network (e.g.,the Internet) via network adapter 20. As depicted, network adapter 20communicates with the other components of computer system/server 12 viabus 18. It should be understood that although not shown, other hardwareand/or software components could be used in conjunction with computersystem/server 12. Examples, include, but are not limited to: microcode,device drivers, redundant processing units, external disk drive arrays,RAID systems, tape drives, and data archival storage systems, etc.

FIG. 4 illustrates a process or system according to the presentinvention for the automated generation of audio selections in responseto speaker or topic content. At 102 a user defines an audio capturesignal within a programmable recording device according to the presentinvention as an audio input of word content recited by the user into amicrophone in communication with the recording device. The capturesignal word content comprises a specific word or a phrase of multiple,specific words that are distinguishable by the recording device fromother words spoken by the user or other users. More particularly, therecording device is configured to identify certain spoken responses orremarks of interest being captured within an audio recording during atime prior to and contemporaneous with an input of the capture signal.

In optional steps or processes within some embodiments of the presentinvention, at 104 the user defines an initial or ending audio boundarysignal as another recitation by the user (via audio input into themicrophone) of a different specific word or phrases that isdistinguishable by the recording device from the capture signal word(s)and from other words spoken by the user or other users.

At 106 during a recording of audio speech presentation by one or moreother people by a recording device according to the present invention,the user recites the specific word or words of the defined capturesignal into a microphone in communication with the recording device.

At 108, in response to recognizing (identifying) an input of the capturesignal from the user (as spoken by the user at 106), the recordingdevice automatically identifies a recording portion start time duringthe current recording of the audio speech presentation that is prior toa time of the input of the capture signal. Aspects identify therecording portion start time through a variety methods and processes,and illustrative but not limiting or exhaustive examples include by aspecified period of time prior to the input of the capture signal; as apoint in time at which a speaker recognized within audio content at thetime of the input of the capture signal of the audio speech presentationfirst starts speaking prior to the time of the input of the capturesignal; or as a point in time at which a specified modifying wordcontent first occurs in the recording of the speech presentation priorto the time of the input of the capture signal. Aspects may alsodetermine the recording portion start time as function of an input ofthe user reciting boundary signal word content, as is discussed morefully below.

At 110 the process captures a portion of the recorded audio speechpresentation that spans backward in time from the input of the capturesignal to an initial, beginning time defined by the recording portionstart time determined at 108. In some examples the recording portionalso spans forward in time from the capture signal. Thus, aspects at 110generate an output of the captured audio portion that is associated withthe capture signal input from the user. Generally different inputs ofthe capture signal each generate different captured audio portions thatare each associated uniquely therewith, wherein the different capturesignal inputs are distinguished via having different unique time stampdata of times of their input at 106, and still other methods fordistinguishing the different capture signals will be apparent to oneskilled in the art.

In some embodiments recording portion start time is identified at 108 bya specified, fixed period of time relative to the capture signal inputtime. For example, the recording device may be configured to the go backfifteen (15) seconds, thirty (30) seconds, one minute, five minutes, orsome other user-specified period in time from the time of the capturesignal input, and in some cases to also go forward to capture additionalspeech data occurring after the time of the capture signal input.

Aspects also identify the recording portion start time at 108 byanalyzing a sampling portion of the recorded audio occurring immediatelyprevious in time to the time of the capture signal input to uniquelydistinguish and recognize a speaker generating recorded audio speechdata most recently prior to the time of the capture signal input,relative to speech data recorded from the user generating the capturesignal and from any other speaking voices present on the audio data overthe sampling period. Such aspects review the recorded data leading up tothe time of the capture signal input to determine a point in time atwhich the distinguished and recognized speaker first started speaking,and uses this point in time as the recording portion start time. Thus,such embodiments recognize the speaker and back up to a point where thespeaker begins to speak.

Specific context word content spoken by the user in a pre-definedproximity to the capture signal words may also be used by the recordingdevice to determine the recording portion start time and thereby thespan of the captured audio portion. Proximity may be defined in terms oftime, or in terms of number of other spoken words between the specificcontext word content and the capture signal words, as determined viatext-to-speech analysis of the recorded audio, and still othertechniques will be apparent to one skilled in the art. Some aspectsautomatically associate another person's name spoken by the userimmediately before or after, or within a specified number of words ortime period of, the capture signal to identify that the beginning orending times for the captured portion should correlate with the timesthat the identified person starts or stops talking, over a time periodinclusive of the time of the capture signal input.

For example, if the capture signal is the phrase “good point,” and theuser says “good point, Janet,” some aspects recognize that Janet is thespeaker to be used to define to recording portion start time of thecaptured portion, and go back in time to a point at which Janet firstbegins to speak (and in some aspects forward to a time after the time ofthe input of the capture signal where Janet stops speaking, in responseto determining that said speaker continues to speak after the time ofthe capture signal input. Such aspects may override the automaticdeterminations made via proximity to the capture signal as describedabove: for example, if Janet has paused while talking, and John sayssomething immediately prior to the time of the capture signal input,rather than use John's speech to define the captured portion, thisaspect is signaled by the recitation of Janet's name immediately afterthe capture signal to instead use the speech audio by Janet to definethe captured audio portion.

A variety of techniques may be practiced to determine a point in time atwhich a recognized speaker first starts speaking, or stops speaking. Forexample, a threshold pause period may be defined wherein if review offthe recorded data finds a break in a continuous speech by the speakerfor a time period greater than the threshold pause period then theaspects determine that the speakers has stopped speaking.

In some aspects the recording device uses the initial audio boundarysignals optionally defined (at 104, FIG. 4) in combination with thecapture signal to determine the stopping point for going back in timefrom the time of the capture signal input to capture audio selectionportion data within an audio recording during time prior to andcontemporaneous with an input of the audio signal. The recording devicemay also use the ending audio boundary signal in combination with thecapture signal to determine a stopping point for going forward in timefrom the time of the capture signal input to capture audio selectionportion data within an audio recording during time prior to andcontemporaneous with an input of the audio signal. Thus, the initial andending boundary signals may be used to define beginning and ending timesof a captured audio selection portion inclusive of the time of thecapture signal input.

The boundary signals may be defined as specific words or phrases thatthe system uses to modify the automatic portion capture times anddefinition. For example, a phrase “with regard to” may be a boundarysignal that, when used in combination with the capture signal overridesdefault portion definitions with respect to an associated modifying wordcontent. Thus, “good point Janet with regard to the green widget” may berecognized as a sequential combination of the defined capture signalword content (“good point”), speaker identification content (“Janet”),the boundary signal content (“with regard to”) and modifying wordcontent (“green widget”). In response, a recording device according tothe present invention captures an audio data portion from speech datagenerated by Janet from the earliest point in time at which themodifying word content (the “green widget”) is found within the recordeddata.

Aspects may also extend the recording time, or limit it, to a periodcovering discussion of the green widget, perhaps excluding other speechdata from Janet that is contemporaneous (immediately before or after)the discussion of the green widget.

Aspects may also extend a capture period defined from the recordingportion start time to the time of the input of the capture signal bysome specified additional tolerance or buffer time period, to therebycapture contextual discussions occurring before or after the timeportion as well.

Aspects of the recording device may define the audio capture andboundary signals in association with unique voice profile data of theuser defining the signals, wherein said unique voice profile dataenables the recording device to distinguish spoken word audio datareceived from the user via microphone inputs from other spoken wordaudio data received from another speaker via microphone inputs. Thus, inthese examples the audio signals are only recognized when the userspeaks their associated word content them into a microphone input, andnot in response to being spoken by any other person. These embodimentsare useful for recordings generated from inputs from a commonmicrophone, or from multiple microphones.

Some aspects may use other signals or inputs to initiate or limit theaudio capture features, such as a toggle or button on a microphone thatmay be used to manually signal the recording device to begin or end theprocesses described above.

Some aspects acquire the audio data prior in time to the input of thecapture signal by buffering the recording of the audio data, and onlysaving the relevant portions when the user signals the deviceappropriately.

At the conclusion of an event, conversation, meeting, etc. from whichthe audio data is generated, the user may easily capture the audio fileand send it to another person, or to a storage device locally, on anetwork or in the cloud, or post it on a social network service, etc.The user may also convert the audio portion to text via a speech-to-textapplication and send the text data to another person or storage device,post it, etc.

Some aspects may also be applied to audio data recorded and transformedto text via a speech-to-text application. Thus, when the capture signal(“good point”) appears in the transcribed text, aspects of the presentinvention may analyze the transcribed text to select a portion of thetext that is relevant (generate by) an audience member or other speakerthat generated the speech data resulting in the text material appearingimmediately before the occurrence of the capture signal words in thetranscription. The boundary signals or other capture portion variationsdescribed above may likewise be applied to the text transcription togenerate a desired capture portion of the entire event transcription.

Thus, aspects of the present invention quickly and efficiently enable aspeaker to an audience to accurately generate notes from captured audioportions designated by the user of interest, via initiating the creationof the portions through affirmative capture signal inputs. It isdifficult in the prior art for a presentation speaker to take notesduring the presentation. During interactions with audience memberspeople of interest may comment or speak to the presenter or the generalaudience, or questions or answers from the audience may be of interestto the speaker or otherwise desirable for memorializing (potentialactions, ideas to pursue or follow-up on, additional research toconsider, etc.). However, it is generally difficult for the speaker tostop his or her presentation long enough to take notes to memorializethe items or people of interest, or notes thereon. While the prior artenables recording of an entire presentation, or of a selection goingforward into the future after initialization of a recording (pushing arecord button, etc.), for later review by the speaker, such approacheseither generate too much data (the entire presentation), or miss itemsof interest (the discussions leading up to the pushing of the recordbutton).

In contrast, aspects of the present invention enable capturing ofportions of an on-going speech or conversation in response tospeaker-generated capture signals that go back in time just far enoughto capture relevant points. Aspects may be used and deployed via subtlesignals that do not interrupt the flow of the presentation, and enable aspeaking user to continue to make a presentation without disruptingtheir thought process, or that of the listening audience.

The terminology used herein is for describing particular aspects onlyand is not intended to be limiting of the invention. As used herein, thesingular forms “a”, “an” and “the” are intended to include the pluralforms as well, unless the context clearly indicates otherwise. It willbe further understood that the terms “include” and “including” when usedin this specification specify the presence of stated features, integers,steps, operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof. Certainexamples and elements described in the present specification, includingin the claims and as illustrated in the figures, may be distinguished orotherwise identified from others by unique adjectives (e.g. a “first”element distinguished from another “second” or “third” of a plurality ofelements, a “primary” distinguished from a “secondary” one or “another”item, etc.) Such identifying adjectives are generally used to reduceconfusion or uncertainty, and are not to be construed to limit theclaims to any specific illustrated element or embodiment, or to implyany precedence, ordering or ranking of any claim elements, limitationsor process steps.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

What is claimed is:
 1. A computer-implemented method for the automatedgeneration of audio selections, comprising executing on a computerprocessor the steps of: defining a capture signal as an audio input intoa microphone of a recording device of a recitation by a user of wordcontent that is selected from the group consisting of a specific word,and a phrase of multiple specific words; in response to an audio inputof the user reciting the capture signal word content into a microphonein communication with a recording device during a recording of a speechpresentation by the recording device, recognizing an input of thecapture signal word content to the recording device; in response torecognizing the input of the capture signal word content from the user,identifying a recording portion start time during the current recordingof the audio speech presentation that is prior to a time of the input ofthe capture signal; and driving the recording device to capture aportion of the recorded audio speech presentation over a period of timespanning from the recording portion start time to the time of the inputof the capture signal word content.
 2. The method of claim 1, furthercomprising: integrating computer-readable program code into a computersystem comprising a processor, a computer readable memory in circuitcommunication with the processor, and a computer readable storage mediumin circuit communication with the processor; and wherein the processorexecutes program code instructions stored on the computer-readablestorage medium via the computer readable memory and thereby performs thesteps of defining the capture signal, recognizing the input of thecapture signal word content to the recording device in response to theaudio input of the user reciting the capture signal word content intothe microphone during the recording of the speech presentation,identifying a recording portion start time during the current recordingof the audio speech presentation in response to recognizing the input ofthe capture signal word content from the user, and driving the recordingdevice to capture the portion of the recorded audio speech presentationover the period of time spanning from the recording portion start timeto the time of the input of the capture signal word content.
 3. Themethod of claim 2, wherein the computer-readable program code isprovided as a service in a cloud environment.
 4. The method of claim 1,further comprising: determining the recording portion start time as atime occurring a specified, fixed period of time prior to the time ofthe input of the capture signal word content.
 5. The method of claim 1,wherein spoken content by a plurality of people including the user isaudible within audio data recorded by the recording device from thespeech presentation, the method further comprising: analyzing a samplingportion of the recorded audio speech presentation that occursimmediately previous in time to the time of the input of the capturesignal word content, to uniquely distinguish and recognize a speakergenerating recorded audio speech data most recently prior to the time ofthe input of the capture signal word content, relative to speech datarecorded from the user generating the capture signal and from any otherspeaking voices present on the audio data over the sampling period,wherein the recognized speaker is different from the user; and reviewingthe recorded audio speech presentation to identify the recording portionstart time as a point in time that is prior to the time of the input ofthe capture signal word content at which the recognized speaker firststarted speaking.
 6. The method of claim 5, further comprising:selecting the recognized speaker from a plurality of speakers of whichtheir voices are each present on the audio data over the samplingperiod, in response to word content of an audio input of the userreciting the name of the recognized speaker within a specified proximityto the capture signal word content.
 7. The method of claim 5, furthercomprising: defining an audio boundary signal as an audio input into themicrophone of a recitation by the user of word content that is differentfrom the capture signal word content and is selected from the groupconsisting of another specific word, and another phrase of multiplewords; in response to an audio input of the user reciting the boundarysignal word content into the microphone during the recording of thespeech presentation and within a specified proximity in time to the timeof the input of the capture signal word content, identifying wordcontent occurring after the boundary signal word content within therecording of the speech presentation as modifying word content; andreviewing the recorded audio speech presentation to identify therecording portion start time as a point in time prior to the time of theinput of the capture signal word content at which the modifying wordcontent first occurs in the recording of the speech presentation.
 8. Themethod of claim 7, further comprising: analyzing a sampling portion ofthe recorded audio speech presentation that occurs immediately previousin time to the time of the input of the capture signal word content touniquely distinguish and recognize a speaker generating recorded audiospeech data most recently prior to the time of the input of the capturesignal word content, relative to speech data recorded from the usergenerating the capture signal and from any other speaking voices presenton the audio data over the sampling period, wherein the recognizedspeaker is different from the user; reviewing the recorded audio speechpresentation to identify a point in time that is prior to the time ofthe input of the capture signal word content at which the recognizedspeaker first started speaking; and identifying the recording portionstart time as the point in time at which the modifying word contentfirst occurs in the recording of the speech presentation in response todetermining that the point in time at which the recognized speaker firststarted speaking is subsequent in time to the point in time at which themodifying word content first occurs in the recording of the speechpresentation.
 9. A system, comprising: a processor; a computer readablememory in circuit communication with the processor; and a computerreadable storage medium in circuit communication with the processor;wherein the processor executes program instructions stored on thecomputer-readable storage medium via the computer readable memory andthereby: defines a capture signal as an audio input into a microphone ofa recording device of a recitation by a user of word content that isselected from the group consisting of a specific word, and a phrase ofmultiple specific words; in response to an audio input of the userreciting the capture signal word content into a microphone incommunication with a recording device during a recording of a speechpresentation by the recording device, recognizes an input of the capturesignal word content to the recording device; in response to recognizingthe input of the capture signal word content from the user, identifies arecording portion start time during the current recording of the audiospeech presentation that is prior to a time of the input of the capturesignal; and drives the recording device to capture a portion of therecorded audio speech presentation over a period of time spanning fromthe recording portion start time to the time of the input of the capturesignal word content.
 10. The system of claim 9, wherein the processorexecutes the program instructions stored on the computer-readablestorage medium via the computer readable memory and thereby determinesthe recording portion start time as a time occurring a specified, fixedperiod of time prior to the time of the input of the capture signal wordcontent.
 11. The system of claim 9, wherein spoken content by aplurality of people including the user is audible within audio datarecorded by the recording device from the speech presentation, andwherein the processor executes the program instructions stored on thecomputer-readable storage medium via the computer readable memory andthereby: analyzes a sampling portion of the recorded audio speechpresentation that occurs immediately previous in time to the time of theinput of the capture signal word content, to uniquely distinguish andrecognize a speaker generating recorded audio speech data most recentlyprior to the time of the input of the capture signal word content,relative to speech data recorded from the user generating the capturesignal and from any other speaking voices present on the audio data overthe sampling period, wherein the recognized speaker is different fromthe user; and reviews the recorded audio speech presentation to identifythe recording portion start time as a point in time that is prior to thetime of the input of the capture signal word content at which therecognized speaker first started speaking.
 12. The system of claim 11,wherein the processor executes the program instructions stored on thecomputer-readable storage medium via the computer readable memory andthereby selects the recognized speaker from a plurality of speakers ofwhich their voices are each present on the audio data over the samplingperiod, in response to word content of an audio input of the userreciting the name of the recognized speaker within a specified proximityto the capture signal word content.
 13. The system of claim 11, whereinthe processor executes the program instructions stored on thecomputer-readable storage medium via the computer readable memory andthereby: defines an audio boundary signal as an audio input into themicrophone of a recitation by the user of word content that is differentfrom the capture signal word content and is selected from the groupconsisting of another specific word, and another phrase of multiplewords; in response to an audio input of the user reciting the boundarysignal word content into the microphone during the recording of thespeech presentation and within a specified proximity in time to the timeof the input of the capture signal word content, identifies word contentoccurring after the boundary signal word content within the recording ofthe speech presentation as modifying word content; and reviews therecorded audio speech presentation to identify the recording portionstart time as a point in time prior to the time of the input of thecapture signal word content at which the modifying word content firstoccurs in the recording of the speech presentation.
 14. The system ofclaim 13, wherein the processor executes the program instructions storedon the computer-readable storage medium via the computer readable memoryand thereby: analyzes a sampling portion of the recorded audio speechpresentation that occurs immediately previous in time to the time of theinput of the capture signal word content to uniquely distinguish andrecognize a speaker generating recorded audio speech data most recentlyprior to the time of the input of the capture signal word content,relative to speech data recorded from the user generating the capturesignal and from any other speaking voices present on the audio data overthe sampling period, wherein the recognized speaker is different fromthe user; reviews the recorded audio speech presentation to identify apoint in time that is prior to the time of the input of the capturesignal word content at which the recognized speaker first startedspeaking; and identifies the recording portion start time as the pointin time at which the modifying word content first occurs in therecording of the speech presentation in response to determining that thepoint in time at which the recognized speaker first started speaking issubsequent in time to the point in time at which the modifying wordcontent first occurs in the recording of the speech presentation.
 15. Acomputer program product for the automated generation of audioselections, the computer program product comprising: a computer readablestorage medium having computer readable program code embodied therewith,wherein the computer readable storage medium is not a transitory signalper se, the computer readable program code comprising instructions forexecution by a processor that cause the processor to: define a capturesignal as an audio input into a microphone of a recording device of arecitation by a user of word content that is selected from the groupconsisting of a specific word, and a phrase of multiple specific words;in response to an audio input of the user reciting the capture signalword content into a microphone in communication with a recording deviceduring a recording of a speech presentation by the recording device,recognize an input of the capture signal word content to the recordingdevice; in response to recognizing the input of the capture signal wordcontent from the user, identify a recording portion start time duringthe current recording of the audio speech presentation that is prior toa time of the input of the capture signal; and drive the recordingdevice to capture a portion of the recorded audio speech presentationover a period of time spanning from the recording portion start time tothe time of the input of the capture signal word content.
 16. Thecomputer program product of claim 15, wherein the computer readableprogram code instructions for execution by the processor further causethe processor to determine the recording portion start time as a timeoccurring a specified, fixed period of time prior to the time of theinput of the capture signal word content.
 17. The computer programproduct of claim 15, wherein spoken content by a plurality of peopleincluding the user is audible within audio data recorded by therecording device from the speech presentation, and wherein the computerreadable program code instructions for execution by the processorfurther cause the processor to: analyze a sampling portion of therecorded audio speech presentation that occurs immediately previous intime to the time of the input of the capture signal word content, touniquely distinguish and recognize a speaker generating recorded audiospeech data most recently prior to the time of the input of the capturesignal word content, relative to speech data recorded from the usergenerating the capture signal and from any other speaking voices presenton the audio data over the sampling period, wherein the recognizedspeaker is different from the user; and review the recorded audio speechpresentation to identify the recording portion start time as a point intime that is prior to the time of the input of the capture signal wordcontent at which the recognized speaker first started speaking.
 18. Thecomputer program product of claim 17, wherein the computer readableprogram code instructions for execution by the processor further causethe processor to select the recognized speaker from a plurality ofspeakers of which their voices are each present on the audio data overthe sampling period, in response to word content of an audio input ofthe user reciting the name of the recognized speaker within a specifiedproximity to the capture signal word content.
 19. The computer programproduct of claim 17, wherein the computer readable program codeinstructions for execution by the processor further cause the processorto: define an audio boundary signal as an audio input into themicrophone of a recitation by the user of word content that is differentfrom the capture signal word content and is selected from the groupconsisting of another specific word, and another phrase of multiplewords; in response to an audio input of the user reciting the boundarysignal word content into the microphone during the recording of thespeech presentation and within a specified proximity in time to the timeof the input of the capture signal word content, identify word contentoccurring after the boundary signal word content within the recording ofthe speech presentation as modifying word content; and review therecorded audio speech presentation to identify the recording portionstart time as a point in time prior to the time of the input of thecapture signal word content at which the modifying word content firstoccurs in the recording of the speech presentation.
 20. The computerprogram product of claim 19, wherein the computer readable program codeinstructions for execution by the processor further cause the processorto: analyze a sampling portion of the recorded audio speech presentationthat occurs immediately previous in time to the time of the input of thecapture signal word content to uniquely distinguish and recognize aspeaker generating recorded audio speech data most recently prior to thetime of the input of the capture signal word content, relative to speechdata recorded from the user generating the capture signal and from anyother speaking voices present on the audio data over the samplingperiod, wherein the recognized speaker is different from the user;review the recorded audio speech presentation to identify a point intime that is prior to the time of the input of the capture signal wordcontent at which the recognized speaker first started speaking; andidentify the recording portion start time as the point in time at whichthe modifying word content first occurs in the recording of the speechpresentation in response to determining that the point in time at whichthe recognized speaker first started speaking is subsequent in time tothe point in time at which the modifying word content first occurs inthe recording of the speech presentation.